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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
12/6/2006 & 10/6/2006 has been entered. 

Claim Objections 

2. Claims 2, 12 & 17 are objected to because of the following informalities: 
Each of claims 2, 12 & 17 recites "the distance" in the last part of each claim. 

This limitation should be corrected to read as - a distance --. Appropriate correction is 
required. 

Response to Arguments 

3. Applicant's arguments with respect to claims 2-7, 12-20, 23-27, 29 & 30 have 
been considered but are moot in view of the new ground(s) of rejection. 
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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 2-7, 12-20, 23-27, 29 & 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kung et al (US 5,850,470) in view of lijima et al (US 6,823,080 B2). 

i 

Regarding claim 2, Kung discloses an image selecting apparatus (10) from 
among a plurality of images (video images of an arbitrary scene 11) obtained by 
continuously photographing a subject (see Fig. 1; col. 4, lines 1-54), comprising: 

an extractor (14, 18, 22) extracting data of an aimed object (face, eyes and other 
facial features) from each of said plurality of images, said aimed object corresponding to 
an independent object (e.g., eyes) within the image (within the image scene 11) at 
which a photographer aims (see Fig. 1; col. 4, lines 1-54); 

a condition-storing unit (face database 16, eye database 20, person database 
26) storing a plurality of predetermined selection conditions (predetermined face 
features, eyes features, etc.) for a desirable aimed object, each of the stored 
predetermined selection condition being specified by a user (Fig. 1; col. 4, line 1 - col. 

5, line 26; note that the predetermined selection condition have been specified by the 
user in advance during create the databases); 

a selecting unit (18, 22, 24) selecting at least one selection condition (i.e., at least 
eyes features stored in eye database 20 for recognizing various different eyes) from 
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among the plurality of predetermined selection conditions resulting in a selection of a 
desired image (a desired image having a person's face is selected for further 
processing after face detector 14) including a desired aimed object from among said 
plurality images, said desired aimed object satisfying said at least one selection 
condition (at least eyes features) stored in said condition-storing unit. See col. 4, lines 
24-54. 

Kung does not teach that said extractor extracts said data of aimed object based 
on depth information indicating the distance from the photographer's camera to at least 
one part of said subject. 

However, as taught by lijima, an imaging system comprises an extractor (image 
separator 105, Fig. 3B) for extracting data of an aimed object (object 2, Fig. 2) based on 
depth information (i.e., focal length of imaging system) indicating a distance (by virtue of 
focal length value f) from the photographer's camera to at least one part of said subject 
(lijima, col. 13, line 64 - col. 14, line 45). lijima suggests that data of an aimed object is 
precisely extracted by using the depth information as shown in col. 14, lines 30-45. 

Therefore, it would have been obvious to one of ordinary skill in the art to modify 
the imaging apparatus of Kung in view of the teaching of lijima such that the extractor 
extracts said data of aimed object based on depth information indicating the distance 
from the photographer's camera to at least one part of said subject. Doing this would 
improve extraction of an aimed object with a high precision for further processing as 
suggested by lijima above. 
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Regarding claim 3, Kung in view of lijima also discloses that the extractor 
extracts said data of said aimed object based on image information included in each of 
said images (see Kung, col. 4, lines 14-54). 

Regarding claim 4, Kung in view of lijima also discloses that the extractor detects 
a judgment location (i.e., eye coordinates) from said data of said aimed object based on 
image information included in each of said images (Kung, col. 4, lines 35-54), said at 
least one selection condition includes a predetermined selection condition (i.e., 
coordinates of various different eyes stored in the eye database 20) related to a 
desirable judgment location, and said selecting unit selects said desired aimed object 
including a judgment location satisfying said at least one selection condition related to 
said desirable judgment location (for the person to be recognized). See Kung, col. 4, 
lines 35-54 and col. 5, lines 10-15. 

Regarding claim 5, see the analysis of claim 3, and note that "data of a plurality 
of said aimed objects from each of said plurality of images" is indicated by data of 
plurality of eyes, eyebrows and nose as described in col. 4, lines 44-54. 

Regarding claim 6, the limitations are also met by the analysis of claim 4. Note 
the Examiner's comment in claim 5. 
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Regarding claim 7, Kung discloses that the selecting unit further comprises an 
image composite unit compositing said plurality of desired aimed objects (eyes, 
eyebrows and nose) to form a composite image (a face formed with facial features as 
shown in Fig. 1; col. 4, lines 55-65), said composite image including said plurality of 
desired aimed objects for each of said plurality of aimed objects extracted from said 
plurality of images. 

Regarding claims 12-16, all limitations of claims 12-16 are also met by the 
analyses of claims 2-6, respectively. 

Regarding claim 17, Kung in view of lijima discloses all limitations of claim 17 as 
discussed in claim 2. Furthermore, lijima teaches microcomputer (900 shown in Fig. 4) 
that executes a program stored in a recording medium (910 shown in Fig. 4) for 
controlling the operation of the imaging system (see lijima, col. 12, lines 42-45). Such 
implementation of a program would enhance system flexibility for upgrade without 
increasing hardware circuitry. 

Therefore, it would have been obvious to one of ordinary skill in the art to modify 
the imaging apparatus in Kung in view of the teaching of lijima by using a program 
stored in a memory which is to be executed by a microprocessor for processing images 
so as to enhance system flexibility for upgrade without increasing hardware circuitry. 
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Regarding claim 18, it is clear that the conditions relate to at least one of shape 
or size of eyes or nose of the aimed object (see Kung, col. 4, lines 24-54). 

Regarding claim 19, Kung also discloses that at least one predetermined 
selection condition relates to expression of said aimed object for identifying said desired 
aimed object. See Kung, Fig. 1 and col. 4, lines 24-54, wherein expression of the aimed 
object is indicated by the shape or size of the eyes, eyebrows or nose in a normal 
expression. 

Regarding claim 20, it is also clear that the selecting unit selects said desired 
image without an operation of a user (automatic face recognition; see Kung, col. 4, lines 
1-3). 

Regarding claims 23-26, see the analyses of claims 19 & 20. 

Regarding claims 27 & 29, as seen in Kung, Fig. 1 and col. 4, lines 1-64, at least 
one of the predetermined conditions (i.e., at least one of eyes features) is selected by 
the user in advance (during setting the eye database 20) from a plurality of potential 
selection conditions (i.e., faces, noses and other eyes features). 



Regarding claim 30, see the analysis of claim 27. 
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Conclusion 



5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nhan T. Tran whose telephone number is (571) 272- 
7371 . The examiner can normally be reached on Monday - Friday, 8:00am - 4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Patent Examiner 



